Sequentially generated states for the study of two dimensional systems 
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Matrix Product States can be defined as the family of quantum states that can be sequentially 
generated in a one-dimensional system [J]. We introduce a new family of states which extends 
this definition to two dimensions. Like in Matrix Product States, expectation values of few body 
observables can be efficiently evaluated and, for the case of translationally invariant systems, the 
correlation functions decay exponentially with the distance. We show that such states are a subclass 
of Projected Entangled Pair States and investigate their suitability for approximating the ground 
states of local Hamiltonians. 

PACS numbers: 03.67.Mn, 02.70.-c, 75.10.Jm 



I. INTRODUCTION 

The description of quantum many-body systems is a 
complex problem due to the exponential growth of the 
dimension of the Hilbert space with the number of parti- 
cles. In many cases of physical interest, however, states 
can be approximately described with a small number 
of parameters. This is the reason for the success of 
techniques such as the Density Matrix Renormalization 
Group (DMRG) 0, or those based on Matrix Product 
State (MPS) representations Q. Those techniques take 
advantage of the local character of physical interactions, 
which favors states with a small amount of entangle- 
ment Their applicability is, however, limited to one- 
dimensional systems. 

MPS have a natural generalization to higher dimen- 
sional systems, namely the Projected Entangled Pair 
States (PEPS) Both representations are complete, 
i.e. any state of the Hilbert space can be written as a MPS 
or PEPS, and they have an efficient description in terms 
of the required number of parameters. However, they 
have very different properties. For example, MPS can be 
efficiently created [l[ and classically simulated what 
makes them extremely useful for the study of quantum 
ID systems. However, creating and simulating PEPS has 
been shown to be much harder Already computing 
local expectation values on PEPS has an exponential cost 
in the general case. Nevertheless, they have proved suc- 
cessful for studying the ground states properties of 2D 
systems by means of an approximate method [H, 0] • In 
spite of having polynomial cost in all the parameters in- 
volved, the consumption of computational resources lim- 
its the application of those methods to relatively small 
2D systems Q or large ones but with moderate precision 

a. 

One of the goals in the research with many-body sys- 
tems is to find other families of states providing an ef- 
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ficient description of systems in two or higher dimen- 
sions, while keeping a more benign behavior with re- 
gard to the determination of expectation values. Those 
studies may find immediate applications in the numer- 
ical studies of the physics of strongly correlated quan- 
tum systems. Thus, in the last years, other classes 
of states and corresponding variational methods have 
also been proposed to describe higher dimensional sys- 
tems SEE El El El El- 

In this paper we present and discuss a new general- 
ization of MPS to two dimensions. The family of states 
introduced here is a subfamily of PEPS, specialized for 
2D lattices: (i) which can be efficiently constructed and 
(ii) for which the expectation values can be efficiently de- 
termined. These properties (inherited from MPS) make 
such states candidates for variational algorithms that 
search for ground states of local Hamiltonians. 

The rest of the paper is organized as follows. In the 
next section we review the definitions and properties of 
MPS and their PEPS generalization. In section Mil we 
introduce the new family of states by presenting two al- 
ternative ways of extending the MPS construction to 2D 
systems. In subsection IIII Bl the main properties of such 
generalizations are discussed, whereas IIII CI shows their 
performance as ansatz for a variational algorithm. We 
conclude with a discussion of these results in section IIVI 
The complete proof of the exponential decay of correla- 
tions in a translationally invariant state is deferred to the 
appendix. 



II. EFFICIENT REPRESENTATIONS OF 
QUANTUM MANY-BODY STATES 

As discussed above, having a representation of quan- 
tum states that captures the essential entanglement fea- 
tures turns out to be most desirable for the study of quan- 
tum many-body systems. A good representation should 
additionally satisfy some other properties. It is not only 
necessary that the state can be described or well approx- 
imated in this manner, but also to be able to find such 
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a description and to determine physical quantities in an 
efficient way. 

Matrix Product States satisfy all these requirements 
for one dimensional systems. In the case of higher dimen- 
sions, the PEPS family provides also an efficient repre- 
sentation of states, which by contrast results in a costly 
calculation of physical quantities. The following para- 
graphs review both families and their properties in some 
detail. 



A. One dimensional systems: Matrix Product 
States 

As already discussed, MPS constitute the paradigm of 
an efficient representation for one dimensional quantum 
many-body systems Q. Here we recall the various ways 
in which they can be defined, as well as their most sig- 
nificant properties. 



1. Definition 

Let us consider a chain of N d-dimcnsional systems. 
MPS are defined in several equivalent ways. 

• Valence Bond picture. Each one of the physical 
spins is assigned two virtual particles of dimension 
D, each of them sharing a maximally entangled 

state (bond), Yl a =i l a > a )' w ^ n their neighbor. The 
state of the chain is obtained by applying at each 
site k a map Pk from the virtual pair onto the phys- 
ical spin (see Fig. 



1(a)). If the mapping on site k 
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the states constructed by this procedure have the 
form 
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(b) Sequential application of unitaries on groups of M + 1 = 2 sites 



FIG. 1: Scheme of MPS construction. In 1(a) each entan 



gled virtual pair is shown as a joined pair of circles, whereas 
the dashed circles represent the maps Pk o nto th e physical 
spins, represented by vertical segments. In 1(b) each box 



represents the application of a unitary U on two neighboring 
sites, and vertical lines correspond again to spin indices. The 
dashed lines show how A matrices can be obtained from this 
sequential construction. 



• Effective site blocks. Another possibility to con- 
struct a MPS is to assign matrices A\ to blocks of 
M sites, instead of individual sites. The so con- 
structed state is analogous to (JTJ) , 
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where now the sum runs over effective "spin" in- 
dices ik of dimension d . This gives again a way 
to construct the state, namely by applying unitary 
matrices, as described above, that act sequentially 
on groups of adjacent blocks. 
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where each matrix A\ has maximum dimension D x 
D. 

Sequential generation. As shown in [l[, an arbitrary 
MPS with bond dimension D can be equivalcntly 
generated by the sequential application of unitary 
operations between an ancilla system of dimension 
D and the physical sites of the chain. Alterna- 
tively, the use of the ancillary system can be sub- 
stituted by the application of unitary operations on 
sites of the chain, only, in a sequential manner (see 
1(b) |. In this case, a unitary acting on M 
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Fig._ 

sites can generate all MPS with bond dimension 
d M . 



2. Properties 

The most remarkable properties of MPS are the fol- 
lowing. 

• Basis for DMRG. MPS are intimately connected to 
DMRG and its success in the simulation of large 
ID quantum systems. DMRG algorithms, in fact, 
optimize over MPS of fixed bond dimension, D, to 
approximate the physical state [l5j . In this sense, 
MPS provide a basis for a variational DMRG pro- 
cedure. 

• Efficiently contractable. The computation of ex- 
pectation values of local operators in MPS can be 
done efficiently. Given an operator O = 0\ ® O2 <8> 
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■ ■ ■ §3 On , which is a tensor product of local opera- 
tors, its expectation value reduces to the trace of a 
matrix product 
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where every term fig = Em'W*!*)^!" ® ^fcl 
is a transfer matrix of size D 2 x D 2 . 

• Exponentially decaying correlations in the transla- 
tionally invariant case. If we consider an infinitely 
long chain, described by a translationally invari- 
ant MPS, i.e. with the same A tensor for every 
site, generically the correlations between two sites 
decrease exponentially with the distance between 
them, (O k O k+A ) - (O k )(O k+A ) ~ e" A /«. Here, £ 
is called the correlation length. 

• Complete family. Any state of the Hilbert space 
for N particles can be cast in the form of a 
MPS with sufficiently large bond dimension (D « 
0(d N / 2 ) 0,13). Thus, the MPS classify the whole 
state space according to the dimension D. The low- 
est classes in this hierarchy prove to be most use- 
ful to describe the low energy sectors of quantum 
many-body systems with local interactions. 

• Area Law. By construction MPS satisfy an area 
law, i.e. the entanglement entropy of a block of 
spins scales as the area of the block boundary. In 
the case of a MPS with bond dimension D, as the 
boundary crosses only two bonds, the entropy is 
upper bounded by 21ogZ?. 

• Parent Hamiltonian. Every MPS is the ground 
state of a local Hamiltonian. Under some generic 
constraint on the MPS, this ground state is unique, 
and the parent Hamiltonian is gapped Q . 

• Extensible to mixed states. The notion of MPS is 
extended from pure to mixed states in the class of 
Matrix Product Density Operators (MPDO) [13, 
which can be used to study one dimensional many- 
body systems at finite temperatures. 



B. Generalization to higher dimensions: PEPS 

1. Definition 

The valence bond construction above can be general- 
ized in a natural way to graphs in higher dimensions by 
assigning to each site as many virtual particles as incom- 
ing edges. This yields the definition of PEPS. For exam- 
ple, a generic PEPS for a two dimensional H x V square 
lattice is constructed by representing each physical site 
(r, c) by four auxiliary systems of dimension D, each of 
them sharing a maximally entangled state with the adja- 
cent neighbor, and then mapping all the virtual onto the 



f <a 

p 


<a 

p 

3 <[2,2] , 





p 4 

k d 


b 4 

u 

ft — u4 


ft 


O » 

P 

V w 


m m 





p 

•Vi2.v: 
V *u i 



ft •? 



[H,V] 



FIG. 2: Scheme of PEPS construction. Solid lines join pairs 
of virtual particles that share a maximally entangled state, 
and dashed circles represent the mapping P from the virtual 
particles onto the physical spin at each site. 



physical degrees of freedom at each site (see Fig. [21). The 
state can be written 
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where the four-index tensors B l contain the mapping be- 
tween virtual and physical systems at each site, and the 
function F2 contracts all the virtual indices according to 
the bonds. 



2. Properties 

As a generalization of the MPS construction, PEPS 
share with them some desirable characteristics. In par- 
ticular they are a complete set and satisfy an area law. 
Nevertheless, PEPS can support large correlations and 
cannot be efficiently contracted. Next we detail these 
and other properties. 

• Complete basis. As MPS, PEPS form a complete 
set, i.e. any state can be written as a PEPS with 
high enough bond dimension. 

• No efficient contraction. Contrary to MPS, the cost 
of contracting PEPS scales in general exponentially 
with the number of systems. Therefore to devise a 
variational algorithm based on PEPS it is necessary 
to use approximation methods 0, @] or to restrict 
the variational set to a subfamily of states (as [l8[ 
or the ones described below). 

• Large correlations. Different to the case of MPS, 
the two-point correlation functions in a PEPS do 
not have to decay exponentially with the distance 
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between sites. In [19j, it was shown that there exist 
PEPS with very low bond dimension D = d repro- 
ducing the correlations and expectation values of 
classical thermal states for any classical two-body 
spin Hamiltonian. This is true in particular for the 
classical Ising model at the critical temperature, 
which has algebraically decaying correlations. 

• Area law. Like MPS, PEPS satisfy by construction 
the area law scaling of entanglement entropy, since 
the maximum entropy of a block is determined by 
the number of broken bonds, i.e. the size of the 
boundary (20j . 

• Parent Hamiltonian. Each PEPS is the ground 
state of a local Hamiltonian. If the PEPS satis- 
fies an injectivity condition [2l| . the ground state 
is unique. Different to the case of MPS this does 
not suffice to ensure the gapless character of the 
parent Hamiltonian. 



III. AN ALTERNATIVE GENERALIZATION: 
SEQUENTIAL FAMILIES 

A. Definition 

The central idea of the generalization proposed here is 
to extend the sequential construction scheme of MPS to 
2D systems, by allowing also the application of unitary 
operations along a second dimension. We can proceed in 
two ways. 



1. Sequentially Generated States (SGS) 

For a H x V lattice, we may define a new family of 
states in the following way. We consider each row r to 
be in a pure state described by a certain MPS of bond 
dimension D, defined by tensors A[ r > c l. As already dis- 
cussed, these tensors define a recipe for constructing the 
row states by sequentially applying unitary operations 
on groups of M + 1 neighboring sites, with M = • 
Then we apply a second layer of unitary operations as 
follows. Along each column, c, we apply unitary trans- 
formations on M + 1 sites, starting on the M + 1 bot- 
tommost rows and moving upwards, one row at a time 
(see Fig. 3(a) I . Thus the first unitary applied on column 
c is U^ H ' \ whereas U^'^ is the unitary operation acting 
on the physical index of A^ r ~ M ' c ^ and on the uppermost 
M spin indices after the application of U^ r+1 ' c \ As in 
the MPS case, the bond dimension D along either the 
vertical or the horizontal direction can be increased by 
applying unitary operations on a larger number of sites. 

A well-known state that admits this description is the 
cluster state [22[, which is given by the application of a 
single unitary to every pair of neighbours in the lattice. 
In such case, applications of the unitary to different sites 



commute among themselves and thus we can apply the 
unitaries in the sequential order described above. 



2. Block Sequentially Generated States (B-SGS) 

Although, as described above, there is one natural way 
of extending the SGS construction by using larger uni- 
taries along either direction, it turns out that this pro- 
cedure does not improve the descriptive power of the 
SGS family. Instead, we may think of another gener- 
alization, adapting the idea of MPS construction from 
effective site blocks. We must then define larger effective 
sites on which the two layers of unitaries are then ap- 
plied. To this end, we first define a block taking together 
N physical sites in the same column, so that we are left 
with a|x7 lattice where sites have physical dimension 
d N . On this system we construct a SGS by first applying 
unitary operations horizontally along each of the rows, 
to build MPS, and then connecting the different rows by 
unitary operations on each column, as described above. 
These unitaries now connect neighboring effective sites, 
i.e. blocks of spins (see Fig. 3(b) ). 

Although the first dcfinitioii lIII A Il is clearly contained 
in the second one, the opposite is not true. In fact, this 
second definition provides the systematic way to extend 
the family to cover the whole state space by taking larger 
blocks N, as we will discuss in the following paragraph. 



B. Properties 

Efficiently preparable and contractable. By con- 
struction, both families of sequentially generated 
states can be efficiently realized. Their implemen- 
tation requires only the sequential application of 
local unitary operations along horizontal and ver- 
tical directions. 

To construct a SGS state with bond dimension D 
along both directions the unitary matrices must act 
on M + 1 sites, with D = d M . For a H x V lat- 
tice the total number of unitary operations to be 
applied is then H(V - M) + V(H - M). 

Moreover, the contraction of SGS can also be ef- 
ficiently calculated on a classical computer. It is 
easy to see that computing the norm of such a 
state reduces to the product of norms of all the 
horizontal MPS, as the product of all vertical uni- 
taries appears contracted with exactly its adjoint. 
Therefore, the unitarity of vertical bonding matri- 
ces reduces the normalization of the state to that 
of the underlying MPS. 

The expectation value of the tensor product of a 
small number of local operators can also be ef- 
ficiently calculated. Let us assume that we are 
interested in some tensor product of local opera- 
tors acting on two sites, ji), (12, J2), (O) = 
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(a)Construction of SGS, with unitaries acting on M + 1 = 2 rows 
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(b) Construction of B-SGS, with blocks of N = 2 rows 



FIG. 3: Scheme of sequential construction. In 3(a) each tilted 
line represents a MPS, connecting A tensors in a given row, 
whereas boxes U corres pond to the action of a unitary on 
two neighboring rows. In 3(b) the construction of a B-SGS is 
schematized. The dashed ellipses represent effective blocks of 
sites, each of them described by a single tensor A. The tilted 
lines represent then MPS of larger dimension for a block of 
rows, and the unitary boxes U act now on groups of effective 
sites. 



(0 [ i ujl] <g> [ i* M ). The product of all the unitaries 
that act on a single column is itself a unitary oper- 
ation that commutes with all the others, and with 
local operators acting on different columns. There- 
fore the contribution of all unitaries on columns 
different from j\ and ji cancels in the expectation 
value. The same is true for unitaries on columns 
ji and j2 that only affect rows above i\ and 12, 
respectively. The expectation value can then be 
written as a product of norms of the rows above 
times a contraction of a ladder structure. This is 
easily shown to scale as d 2 D 6 . [3(j 

These arguments hold also for the B-SGS definition 
above, with only the appropriate effective values of 
d, H and D. 

• Subfamily of PEPS. Any SGS state can immedi- 
ately be written PEPS of bond dimension 

upper bounded by D, with tensors B^ r ' c ^ lurd = 



Eli u^- 



,]« A [r-U,cP 

dj 1 A lr' 



Here is the unitary 



matrix that acts on rows r — M to r of column c, 
and A^ r ~ M ' c ' is the MPS tensor corresponding to 
row r — M. The index i is the free spin index of 
site [r,c]. So. the PEPS gets the horizontal (I, r) 
bonds from the r — M row. while the vertical bonds 
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FIG. 4: Any SGS can be written as a PEPS. The picture 
shows the construction of the B tensors for a given column, 
c, in the particular case M = 1 (i.e. unitaries acting on two 
rows). For a generic site, the tensor _B' r ' c ' is thus determined 
by the MPS matrix A corresponding to the site that lies M 
rows above and the unitary that acts on this and the M sites 
below. 



u and v are the composition of M spin indices cor- 
responding to the upper or lower rows (see Fig.[¥]). 

The expression above is valid for rows M < r < H . 
The B tensors in the last row, r = H, would con- 
tain also the contraction with the physical indices 
of all the A matrices corresponding to rows below 
H - M, B^ c l = [/^< c ] A^ H ~ M ^ . . . Al H > c l On the 
other hand, the corresponding term for the last uni- 
tary, U^ M+1 ' c ^*y A^'^fr, will contain the product of 
the B tensors for rows 1 to M + 1, which can be 
obtained from this term by means of singular value 
decompositions. 

The converse is not true, as an arbitrary PEPS can- 
not always be expressed in this form. To express 
an arbitrary B tensor as a SGS we could apply a 
singular value decomposition to split the horizontal 
indices, Ir, from the rest. This may in general yield 
up to D 2 singular values. If this number is larger 
than the physical dimension d, the result will not 
lead to a valid A matrix for a MPS with the same 
physical dimension. This bound on the number of 
singular values of B constitutes a necessary condi- 
tion for a state to be writable as a SGS, but it is 
not sufficient. One needs also that the first part of 
the singular value decomposition admits a reorga- 
nization of the indices to give a unitary matrix. 

For the B-SGS, each product A^~ M ^ will 

render a B tensor corresponding to an effective 
block of sites. To obtain a PEPS representation of 
the same state, such tensor has to be decomposed 
as the contraction of the vertical indices of N in- 
dividual B tensors on the same column. This can 
be always achieved by an adequate singular value 
decomposition. 

Decaying correlations. Due to their construction, 
which generalizes the sequential generation of MPS, 
in a translationally invariant system these states 
show correlations that decay exponentially with the 
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distance along both directions. In this case, the 
translational invariance implies that the state is de- 
scribed by a single A tensor and a single unitary 
operation. 

Although the complete proof of this property can 
be found in the appendix, here we sketch the main 
ideas. To check the property, we analyze indepen- 
dently correlations along the horizontal and vertical 
directions. In the first case, we use the fact that, 
given the translational invariance, the underlying 
horizontal MPS states are exponentially close to a 
product, so that their two-point correlations within 
one row decrease exponentially with the distance. 
Only the second layer of unitaries acting along the 
vertical direction can introduce corrections to this 
decay law. Nevertheless, we observe that such cor- 
rections can increase only linearly with the number 
of rows in the system, so that the exponential decay 
dominates as the total size and the distance tend 
to infinity. 

On the other hand, correlations between two sites 
of the same column that lie on different rows are 
only due to the second layer of unitaries, since in 
absence of the latter the state is a tensor product 
of MPS states for each row. In particular, for the 
kind of correlations under study, the only contribu- 
tion comes from unitaries acting on the single col- 
umn involved. It is easy to see that the situation is 
analogous to a translationally invariant MPS along 
the vertical direction with larger effective site di- 
mension. This immediately implies that such cor- 
relations must also decay exponentially with the 
distance. 

• Area law. Being a subfamily of PEPS, both 
SGS and B-SGS satisfy the area law. 

• Complete family. As discussed above, the family of 
SGS cannot include arbitrary states, as in particu- 
lar they are not always capable to describe a PEPS 
of given bond dimension. Nevertheless, the family 
of B-SGS provides a way of overcoming the limita- 
tions of the first one, by increasing the size of the 
effective blocks. In this way, any state of a finite 2D 
system can be described as a B-SGS by grouping 
together a large enough number of rows, N. No- 
tice that, in the limit, N = H and the B-SGS de- 
scription reduces to a MPS describing a chain of V 
d^-dimcnsional sites. 

• Basis for a variational algorithm. The properties 
above make these families a suitable ansatz for 
a variational algorithm that looks for the ground 
state of local Hamiltonians. The fact that they 
can be efficiently contracted grants the efficiency 
of such procedure. Although the first family can- 
not describe arbitrary states, it is worth to explore 
its performance to find physically interesting states, 
arising as ground states of local Hamiltonians. The 



second family, on the other hand, grants a system- 
atic procedure to improve the description of a sys- 
tem by considering larger and larger blocks of sites. 
The algorithm and the numerical study of its per- 
formance for both sequential families are described 
in the following section. 



C. Variational algorithms 

We consider Hamiltonians with nearest neighbours in- 
teractions, H = Srcfyf-.c]) where each term h\ rtC i con- 
tains interactions of site (r, c) with its adjacent neigh- 
bours in both directions, as well as possibly one-body 
terms. The algorithm should minimize the energy E = 
^JWT^T w ith respect to the family of states in which we 
are interested. 

The procedure can be built as in [T(| by sequentially 
fixing all but one of the matrices (A and U) that define 
the state, and then finding for the free matrix the opti- 
mal value, which minimizes the quantity above. The cost 
of the algorithm will be determined by the cost of con- 
tracting the lattice for local operators, which, as already 
discussed, can be done efficiently 

We carry out this program in two phases. First, we 
apply the iterative procedure over all the A matrices 
that define the horizontal MPS by sweeping over each 
row from left to right and back. This phase of the al- 
gorithm is almost identical to [3]. As described there, 
a gauge condition that ensures normalization is applied 
at each step, as well as techniques to improve the per- 
formance by storing partial contractions in memory as 
we move from one site to another. The only difference is 
that, in this case, different terms of the Hamiltonian con- 
tribute differently depending on the relative position of 
the rows on which they act with respect to the A being 
optimized, and therefore more terms need to be calcu- 
lated and stored as going from one row to the following. 

The second phase of the algorithm consists in the opti- 
mization of the unitary matrices by a similar procedure. 
In this case, however, the quadratic character of (^1 Jf |^) 
as a function of one particular U is not enough to find 
the optimal matrices, because we must also impose the 
unitarity condition. This cannot be done by applying 
a gauge transformation, as is done for the A matrices, 
therefore we employ a slightly different approach in or- 
der to find each U. Instead of directly optimizing the 
quotient above, we apply a small variation to the initial 
value of the unitary matrix, say U^'^ = & &k Uq ' , where 
5 is a small real value and K is an unknown Hermitian 
matrix. To the first order in 5, the energy is a linear 
function in K (and its adjoint) that can be analytically 
optimized, with the constraints of hermiticity K = K* 
and normalization tv{K<K) = 1. For the so found value 
of K, we update the unitary (with the largest possible S) 
and iterate the variation until convergence. 

Contrary to the case of A tensors, the latter pertur- 
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bative procedure does not grant analytically that a min- 
imum is found at each step. In practice, however, this 
approach shows a good convergence. 



1. Numerical results 

To study the performance of this ansatz, we have im- 
plemented the algorithm above in Matlab, and applied 
it to the ground state of different 2-body Hamiltonians, 
H = J2(ij) on 2D lattices. 

The tests have included random 2-body Hamiltonians, 
where each hun is a randomly chosen Hcrmitian operator 
acting on neighboring sites the Heiscnbcrg model, 



-- J, 



o\a 3 z \ and a frustrated XX-model, 
a l a i)j with Juj\ = —1 on every 



h (v) 

fourth edge (in both directions). The algorithm has been 
run for lattices up to size 10 x 10, and the results have 
been compared with those obtained with PEPS (23j . 

The following table shows the results for the SGS fam- 
ily. For the models mentioned above and the specified 
lattice sizes, the table contains the lowest energy found 
with this algorithm, E , using bond dimension D j3l| . 
together with the relative error, e r , with respect to the 
PEPS result (obtained with with bond dimension D = 4 
and time step St = 0.001). 
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2 


-153.737 


0.0254 




8x8 


4 


-154.031 


0.0235 


Hciscnberg 




8 


-154.142 


0.0228 






2 


-244.830 


0.0209 




10x10 


4 


-245.244 


0.0193 






8 


-245.383 


0.0187 






2 


-90.598 


0.016 


frustrated XX 


8x8 


4 


-91.242 


9.0xl0~ 3 






8 


-91.398 


7.3xl0- 3 



We observe that in all cases a good precision is attained 
with very low bond dimension, and increasing D does not 
significantly improve the result, contrary to what occurs 
with MPS or general PEPS. This can be readily under- 
stood from already discussed arguments. Any SGS with 
a fixed bond dimension can be represented as a PEPS 
of the same virtual dimension, but not the other way 
round. The rank of the singular value decomposition of 
the PEPS tensor should be smaller than d for it to yield 
a valid MPS of the same physical dimension. And this 
restriction is independent of the bond dimension allowed 
for the SGS. Hence the ground state of these Hamiltoni- 
ans can only be approximated to a finite precision with 
a SGS of physical dimension d. 



However, constructing the sequential state from blocks 
instead of individual sites allows us to get closer to the 
true ground state by considering larger effective sites, 
and therefore larger effective d. We have applied the 
same algorithm using this B-SGS family as ansatz, with 
effective sites of N = 2 rows. As the following table 
shows, this reduces the relative error in more than 30% 
in all the cases under study (D indicates now the bond 
dimension for the MPS, which was chosen equal to the 
effective dimension, d 2 ). 



model 


original lattice 


N 


D 


Eo 


Er 


random 


8x8 


2 


4 


-169.963 


1.96xl0- 3 


Heisenberg 


8x8 


2 


4 


-155.231 


0.0159 


10x10 


2 


4 


-246.852 


0.0128 


frustrated XX 


8x8 


2 


4 


-91.703 


4.03x10^3 



IV. DISCUSSION 

The study of efficient representations of quantum 
many-body states has been very successful in the de- 
scription of one dimensional systems. Quantum informa- 
tion has provided a different perspective to understand 
these techniques @, [H H, HE US E3- The hierarchy 
of MPS yields an adequate variational class of states for 
numerical methods in one dimension. In higher dimen- 
sions there are theoretical and practical limitations to 
the application of these states or their natural general- 
ization. Therefore it is interesting to look for alternative 
representations that are capable to describe the low en- 
ergy sector of physically relevant systems while offering 
better contractability. 

Here we have presented extensions of the sequential 
construction of MPS to two dimensions which can be 
introduced using two different approaches. Both fami- 
lies defined here represent subsets of states which can be 
efficiently prepared in practice, as their definition imme- 
diately provides a sequential recipe for its preparation. 
We have proved that those states show exponentially 
decaying correlations. Moreover, their contraction can 
also be done efficiently, which makes them a good ansatz 
for variational procedures. We have numerically studied 
the performance of both approaches as ground states for 
different local Hamiltonians. The results show that, al- 
though the suitability of the first approach is limited, the 
second one provides a systematic way of approximating 
the ground state of these systems. Our tests have only 
shown the feasibility of this second approach, which nev- 
ertheless has higher requirements from the computational 
point of view. 

As already discussed, the different performance of both 
families is due to the fact that, for a PEPS to be writable 
as a SGS of dimension d, it is necessary (although not 
sufficient) that the singular value decomposition splitting 
the It PEPS horizontal indices from the rest has at most d 
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values different from zero. Prom a different point of view, 
it is sometimes possible to write a given PEPS with more 
than d singular values in the decomposition above, as a 
certain local projection of a SGS state of larger physical 
dimension onto a d-dimensional subspace for each site. It 
is the case of the toric code (28[, which has a PEPS de- 
scription of D = 2 . The B tensor has four non-zero 
singular values according to the decomposition iud vs Ir. 
If we take the right part of this decomposition as a MPS 
description for a chain of dimension d 1 = 4, it turns out 
to be possible to complete the rest of the decomposition 
onto a 8 x 8 unitary matrix. This would correspond to 
free indices of dimension d' from which we could recover 
the physical d = 2 by projecting onto a local subspace. 

Note that even if the rank of the singular value decom- 
position of B is smaller than d, it is not always possible 
to find a SGS description for the state. For example, 
the PEPS constructed in that reproduces the corre- 
lations and expectation values of thermal states for the 
classical Ising model has very low bond dimension D = d. 
From its explicit representation it is possible to see that 
the rank of the relevant singular value decomposition is 
only d = 2. However, it is not possible in general to 
represent this state as a SGS. 

APPENDIX: PROOF OF THE DECAY OF 
CORRELATIONS 

We want to calculate a correlation function of the form 
(0f^0f 2M ) - {0f uVl] ){0 [ * 2 ' V2] ) on an infinitely 
large 2D lattice with translational symmetry 

The decay of correlations along both directions follows 
from the same property of MPS. Let us first calculate the 
decay in the vertical direction, i.e. that of application of 
the unitaries. Notice that if Vi = V2 = v, each of the 
expectation values above can be written as 

tiiOU^...U^pff PS U^ ...uw\ 

where pmps is the reduced density matrix for the single 
site occupying column v in any of the rows, and h is the 
first row touched by the corresponding operator O. Since 
the state of every row is described by the same MPS, all 
such reduced density matrices are the same. Therefore, 
we are left with a tensor product of H identical single site 
density matrices connected by the sequence of unitaries 
that act on column v. Such a construction, where all the 
degrees of freedom but the ones on column v have been 
traced out, can be written as a MPDO [ijj 

p = y: tv(M^ . . . M^Hh . . . *h)(*[ . . . a 

tfc, i' k 

with matrices of the form \^ 

^ [r C).^) = E^ W ^D r[rI ly- 

7 7' 



The correlation function for operators 0\ and 2 acting 
on rows hi and h 2 can then be calculated using the pu- 
rification of this MPDO, as a (translationally invariant) 
MPS of physical dimension d 2 , for which the correlations 
decay exponentially with the distance h-} — hi. 

If the operators are placed along the horizontal direc- 
tion, hi = hi = h, the expectation value (0^ t ' Vl ^0 2 h ' V2 ^) 
takes a similar form 

(o) = ti(Oi®o 2 . . . &Wp%% hi+1 \my . . . (u^), 

(A.l) 

where each reduced density matrix, Pjjpg, corresponds 
now to two physical sites of row r, those on columns v\ 
and t>2- As the two-sites reduced density matrix of a 
translationally invariant MPS, it is exponentially close 
to a product of single-site density matrices. This can be 
seen by writing its explicit form, 

Here Ei are the D 2 x D 2 transfer matrices which, due 
to the translational invariance, do not depend on the col- 
umn, except for the first and last sites of each row. Under 
some generic condition on matrix E\ Q , the v 2 — v 1 — 1 
power of this matrix can be approximated by a product 
when the distance v 2 — Vi becomes very large, so that 

p~a [vi] ®(T [v2] +£a [viV2] , (A.2) 

where act on a single system each, and the factor 

/. \va— vi — 1 

£ = ( M ) ^ S determined by the ratio of the second 

largest eigenvalue of E\ to the largest one, and decays 
exponentially fast with the distance vi—v\. Moreover, if 
the edges of the lattice are infinitely far away, i.e. vi, V — 
i>2 — > 00, then crl" 1 ! = a^ 2 ' (with a global normalization 
factor). 

Since each row density matrix is exponentially close to 
a product, 

\\p -aW®aW ||i < 0(e), (A.3) 

one can show by induction that this is also the case for 
the -fT-fold tensor product appearing in lA.ll (H 1 = H — 
hi + 1), 

\\p® H ' - (a^)® H ' ® (a [v2] )® H ' \\i < 0{H'e). (A.4) 

The unitary matrices U appearing in (|A. 1[) are the 
tensor products of a unitary matrix acting on the cor- 
responding row and column v\ times the one on column 
v 2 , f/M = Ul r > V1 J ® V2 l Acting with them on the 
tensor product above does not increase the trace norm, 
and moreover respects the tensor product structure of 
the second term, so that the reduced density matrix cor- 
responding to columns v\ and v 2 satisfies 

11^2] _ T W\ %T \v^ x < o(H'e). (A.5) 



9 



Therefore it is easy to show that, for any pair of operators 
Oi, 02 each one acting on <C d , and with operator norm 
bounded by 1, 

|tr(Oi<8)02f Iwi,;2] ) - tr(Oi(»lf[" 1 ^)tr(l®02f[ , ' 1 ^)| 
< AO(H'e). (A.6) 

Thus the correlations decrease exponentially with dis- 
tance [33j . 

Under some additional condition, it is possible to ob- 
tain a tighter bound on the correlations. To this end we 
can define again for a row r the matrices 



M 



r,v] 1 



(aa'),W) 



V TA r ^ W rr [v] TT^* 1 ' 01 



7 7' 



for v = vi, i>2, and an analogous M matrix using a and 
U^ r \ so that the reduced density matrix for sites [h, vi], 
[h, V2] can be written as 



pg = tT(M[> ] .& H - h -V -G [m ), (A.7) 



where 



M [h] = U [h - Vl] 9 U^ h > v ^p(U [h > Vl] y ® (U^ l ' 2l ) t 

» M [h ' Vl] ® M [h ' V2] + eM [h - VlV2] , (A.8) 

and i (j) are the double indices i i' (j j') appearing in the 
M matrices for each site. These indices are traced out 
on rows where no operator acts, yielding 



G [vi] ® G [V2] +sG [viV2] 



(A.9) 



where each individual G<- v ' is obtained by tracing out the 
physical index in M^ h,v ^ . 



If the matrices G^d and G^ 2 ' have a single maximal 
eigenvalue, with multiplicity one, also the whole matrix 
G will have a single maximal eigenvalue /}, with the same 
multiplicity, so that 



-h-1) 



(A) 



plus terms that decrease exponentially with H. The 
leading eigenvectors, using perturbation theory 2j|, will 
be given by the product of eigenvectors of G^ Vl > and 
G^ 2 ! , plus some contributions of order e whose number 
is bounded by the dimension of the (finite) matrices G. 

On the other hand, the last matrix in (|A.7[) . G\g\, is 
the corresponding G matrix for the bottommost unitary, 
which therefore includes, instead of a single row, the ten- 
sor product of all the last M + 1 rows, and then con- 
tributes at most with e(M + 1) terms to the corrections. 



G [H] = U^ H > v ^®U^ H - V2 \p)® M+l (U [H > vl] y ®{U^ H > V2 ^ 

M 

w G[g ® G\ 2 \ +eY J (° [vi] ) k c [vi] (c [vi] ) M ~ k 

k=0 

®{a^) k ^ V2 \a^) M ~ k . (A.10) 
Therefore, under this no-degeneracy assumption for 
matrices G (which seems to be generic, after some nu- 
merics) the corrections to the tensor product structure 
of CO} are of order e(l + 0(£> 4 ) + 0(M)), which docs 
not depend on the size of the system. 
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